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MET-HQDS-QR EFELCIEOT IMPLEMENTATION OF 
TRELLIS BA^EJCLSPEC TRAL SHAPING WIT H^OKAHEAD 

Field of the Invention 



This invention relates to systems an methods for spectral shaping of signals in communications 
systems, and is particularly applicable to data communication equipment like a modem. 

10 Background of the Invention 

In digital communications it is sometimes desirable to avoid transmission at certain frequencies 
in the transmission spectrum. It is usually necessary to do so in order to avoid undesirable 
distortion which might result if communications signals use certain frequency components. The 
1 5 presence of such distortion can lead to unnecessary performance degradation. 

To avoid transmission at the undesirable frequencies in the spectrum it is necessary to shape the 
transmission spectrum of the transmitted signals accordingly. The principles of spectral shaping 
are conveniently described, for example, in United States patent 5,818,879, entitled "Device, 

20 System and Method for Spectrally Shaping Transmitted Data Signals". Previously proposed 
schemes for spectral shaping achieve the desired result by the use of redundancy. One such 
scheme is the trellis based spectral shaping which has been proposed for the V.90 standard to 
be ratified by the ITU-T International Telecommunication Union: 'A digital modem and 
analogue modem pair for use on the public switched telephone network (PSTN) at data 

25 signalling rates of up to 56 000 bit/s downstream and up to 33 600 bit/s upstream' ITU-T 
recommendation V.90, September 1998, Geneva, Switzerland. This scheme uses a 
convolutional code with two states and provides significant gain. 



30 



Summary of the Invention 

A straightforward M-ary tree implementation conventionally requires a start-up phase and a 
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steady-state phase, increasing the complexity. In one aspect of the present invention pre- 
determined state transitions according to a valid trellis path are assumed during the start-up 
phase. The performance penalty for small look-ahead depth is insignificant and deviation if 
present is for a very short duration. 

5 

In accordance with the present invention, there is provided a method of coding digital 
data for transmission according to a trellis coding system having a predetermined number of (N) 
states and a predetennined number of (M) state transitions from each state, wherein the data is 
arranged in a series of frames, a state is associated with each frame to determine a coding 

10 strategy for the frame, and a look-ahead depth (D) representing a number of data frames is 
selected, characterised by the step of: 

assigning an initial state for a first frame of the series of data frames, and assigning 
states for the subsequent data frames in the series of data frames up to the look-ahead depth 
according to a predetermined valid trellis path, the method further including: 

15 sequentially fetching subsequent data frames in the series and determining respective 

states therefor based on a path metric for state transitions computed over the number of frames 
represented by the look-ahead depth; and 

coding the data frames for transmission according to the coding strategies corresponding 
to the stztes assigned or detennined for the frames, wherein the series of data frames are coded 

20 for a shaped spectrum upon transmission thereof. 

The present invention also provides a data encoder for generating spectrally shaped coded data 
according to a trellis coding system, wherein the data is arranged in a series of data frames from 
a data source and a trellis state is associated with each data frame such that a coding scheme for 

25 each frame may be determined on the basis of transitions of states for frames over a selected 
look-ahead depth (D), comprising: 

a buffer memory coupled to the data source for buffering data frames in the series of 
data frames by the selected look-ahead depth (D); 

a metric computation and trellis extension engine coupled to sequentially receive said 

30 data frames from the data source and determine node information in a plurality of nodes for each 
said frame representing possible states, state transitions from a preceding frame and path metrics 
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for the state transitions; 

a current state storage coupled to the metric computation and trellis extension engine for 
storing the state of a current frame in the series of delta frames; 

a node memory coupled to the metric computation and trellis extension engine for 
5 storing said node information for nodes of a frame succeeding the current frame by the look- 
ahead depth; 

a coding scheme memory for storing a correlation between state transitions and 
respective coding schemes; and 

a processing circuit coupled to the coding scheme memory and metric computation and 
10 trellis extension engine for applying a selected coding scheme to a data frame to generate 
spectrally shaped coded data; 

wherein said metric computation and trellis extension engine determines the selected 
coding scheme for the current frame according to the state stored in the current state storage and 
a node for the frame succeeding the current frame by the look-ahead depth which is selected on 
15 the basis of the path metric for the node, characterised by: 

the metric computation and trellis extension engine assigning an initial state for a first 
frame of the series of data frames, and assigning states for the subsequent data frames in the 
series of data frames up to the look-ahead depth according to a predetermined valid trellis path. 

In the preferred for of the present invention, the start-up phase and the steady state are unified. 
20 The trellis shaper chooses a predetermined valid trellis path during the start-up phase 
irrespective of the criterion for selection of the sub-tree. Once in the steady state, it uses the 
selection criterion to select the state transition. 

The trellis shaping function of the preferred embodiment is implemented with a linear structure 
that requires memory for only the nodes at level D of the binary tree. In the steady state phase, 
25 for each input spectral shaper frame X, +D the preferred embodiment computes the path metric 
associated with each of the M°^ 1 paths. The node at level D+l which satisfies the selection 
criterion is then chosen as the best path. The state transition from the current root node and the 
subsequent root node is determined by the current trellis state and the best path. 

The preferred implementation provides a significant reduction in computation and memory 
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requirements, and the performance penalty as a result is insignificant. 

Brief Description of the Drawings 

5 The invention is described in greater detail hereinheiow, by way of example only, through 
description of preferred embodiments and with reference to the accompanying drawings, 
wherein; 

Figure 1 is an exemplary state diagram of a two state trellis spectral shaping code; 
Figure 2 illustrates a steady state binary tree diagram for a two state trellis based 
10 spectral shaping code with look- ahead depth of 3; 

Figure 3 is an exemplary diagram of design of a trellis based spectral shaper; and 
Figure 4 is a block diagram of an encoder for use in a modem or the like in which 
embodiments of the present invention may be implemented. 

15 Detailed Description of the Preferred Embodiments 

By way of background, Figure 4 is a block diagram which illustrates an overview of an encoder 
for use in a digital modem or the like, and represents one data frame. In the following 
description, data frames in the digital modem have a six-symbol structure. Each symbol position 
20 within the data frame is called a data frame interval and is indicated by a cyclic time index, i — 
0, 5. Frame synchronisation between the digital modem transmitter and an analogue modem 
receiver is established during training procedures. 

Mapping parameters for the encoder, established during training or rate renegotiation 
25 procedures, are: 

(i) six PCM code sets, one for each data frame interval 0 to 5, where data frame interval i 
has Mj members; 

(ii) K, the number of modulus encoder input data bits per data frame; 

(iii) S n the number of PCM code sign bits per data frame used as redundancy for spectral 

30 shaping; and 

(iv) S, the number of input data bits for the spectral shaping scheme, where S + S r « 6, define 
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the six PCM code sign bits according to a sign assignment procedure. 

The encoder 10 illustrated in Figure 4 includes a bit parser 12 which receives D (equal to S + K) 
serial input data bits do to d^, and is coupled to a modulus encoder 14 and a spectral shaper 22. 
5 The input data bits d 0 to d^ (where cJq is first in time) are parsed into S sign input bits and K 
modulus encoder bits. The data bits d 0 to d s _, form s 0 to s s . u and d s to d M form b 0 to b K . x . 

Kbits enter the modulus encoder 14. Additionally, there are six independent mapping moduli, 
M 0 to M> , which are the number of members in the PCM code sets defined for data frame 
10 interval 0 to data frame interval 5, respectively. The modulus encoder 14 converts K bits into 
six numbers, to K^, using the following algorithm which is specified in the aforementioned 
proposed standard: 

1 . Represent the incoming K bits as an integer, R^: 

15 Ro * b o + b, m 2 J + b 2 *2 2 + ... + b^" 2 *" 1 

2. Divide Kq by M^ The remainder of this division gives , the quotient becomes Rj for 
use in the calculation for the next data frame interval. Continue for the remaining give 
data frame intervals. This gives K$ to as: 

20 Kj = R, modulo M [y where 0 * K. < R M = (R. - K-) / M- 

3. The numbers K^, Kj are the output of the modulus encoder, where Kq corresponds 
to data frame interval 0 and Kj corresponds to data frame interval 5. 

25 The modulus encoder 14 is coupled to six independent mappers 16 associated with the six data 
frame intervals. Each mapper is a tabulation of M, PCM codes (corresponding to positive 
analogue values) that make up the constellation points of data from interval i. The PCM codes 
to be used in each data frame interval are specified by the analogue modem during training 
procedures. Each mapper 16 receives the quantities from the modulus encoder 14 and forms 

30 Ucode values Uj by choosing the constellation point labelled by K^. 
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Spectral shaping carried out according to the aforementioned standard by the spectral shaper 22 
only affects the sign bits of transmitted PCM symbols. In every data frame of 6 symbol intervals, 
S r sign bits are used as redundancy for spectral shaping while the remaining S sign bits carry user 
information. The redundancy, S r is specified by the analogue modem during training procedures 
5 and can be 0, 1, 2, or 3. When S r = 0 7 spectral shaping is disabled. 

The spectral shaper operates on a spectral shaper frame basis. For the cases S r = 2 and S r = 3, 
there are multiple shaper frames per six-symbol data frame. Spectral shaper operation for each 
shaper frame within a data frame (herein referred to as a shaping frame j) is identical except that 
1 0 they affect different data frame PCM sign bits. In particular, the spectral shaper modifies initial 
sign bits to corresponding PCM code sign bits ($ 0 , without violating the constraint 

described below, so as to optimize a spectral metric. 

The constraint of the spectral shaper can be described by way of a 2-state trellis diagram, such 
15 as that shown in Figure 1 . In a given spectral shaping? frame i, the spectral shaper modifies the 
initial sign sequence according to one of the following four sign inversion rules: 
Rule A; Do nothing; 

Rule B: invert all sign bits in the spectral shaping frame; 
Rule C; Invert odd-numbered sign bits in the spectral shaping frame; 
20 Rule D: Invert even-numbered sign bits in the spectral shaping frame. 

The trellis diagram describes the sequence of sign inversion rules that are allowable. For 
example, when the spectral shaper is in state S 0 at the beginning of frame i, only rules A and B 
are allowable in that frame. The current state together with the sign inversion rule selected for 
25 the frame determine the next state according to the trellis diagram. 

A look-ahead depth parameter D may be an integer between 0 and 3, for example, selected by 
the analogue receiving modem during training procedures. Look-ahead depths of 0 and 1 are 
mandatory in the digital modem according to the aforementioned standard, whereas look-ahead 
30 depths of 2 and 3 are optional. To select the sign inversion rule for the i* spectral shaping frame, 



SUBSTITUTE SHEET (RULE 26) 



WO 00/30311 



PCT/SG98/00094 



- 7- 

the spectral shaper uses the PCM symbol magnitudes produced by the mapper 16 for spectral 
shaping frames i, i+l, i+D. The spectral metric that would result from each of the allowable 
sequences of sign inversion rules for frames i through i+D, starting from the current state, is then 
computed. Based on those computations, the spectral shaper then selects the sign inversion rule 
5 for frame i that minimizes the spectral metric, which is defined as the sum of the squares of the 
RFS up to and including the final symbol of spectral shaping frame i+D. The selection thus 
determines the next state of the system. The spectral shaper then sets the PCM code signs for 
shaping frame according to the selected sign inversion rule. 

10 A trellis based spectral shaping scheme in an embodiment of the present invention uses a 
trellis code with N states and M state transitions from each state (M, N positive integers). 
Performance gain is achieved by using larger redundancy and increasing the look-ahead 
depth. Trellis based spectral shaping is usually implemented using M-ary trees. The 
information to be spectrally shaped is assumed to be framed and is hereafter referred to as the 

15 spectral shaper frame. The size of the spectral shaper frame varies to accommodate 
additionally redundancy bits. The spectral frame size and the look-ahead depth D being 
variables, the complexity of implementation of the spectral shaping technique increases. An 
implementation scheme which deals with all the cases uniformly is desired to make it 
computationally efficient. The memory requiremenjis for the scheme should also be kept as 

20 small as possible. 

The trellis state diagram for the two state trellis is as shown in Figure 1, having two states S 0 
and Sj. The state transitions are labelled a, b, c and d and associated with state transitions 
So — > S 0 , S 0 — >S„ S x — > S 0 and — > S u respectively. The state transition in a trellis 

25 depends on the current state and a selection criteria for the state transition. Only certain 
sequence of state-transitions are allowed, and they constitute a valid path. These valid paths 
are defined by the trellis code. The selection of the state transition for a spectral shaper frame 
X { and using a look-ahead depth of D requires spectral shaper frames &i ...... &d . 

Therefore, on start-up the binary tree should be filled up to level D to commence state 

30 transition assignment. This phase is called the start-up phase. The first state in the trellis is 
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pre-defined and the first state transition thus emanates from that predetermined state. The 
start-up phase lasts for D spectral shaper frames, and thereafter the system enters into a steady 
state phase. The state transition selected is one of the two possible state transitions from the 
current state S l and the criterion for selection is the metric computed for spectral shaper frame 

For the case of N=2, and M=2, a complete binary tree T can be constructed with the root 
node being the current state S r The maximum level of the tree is D + 1 where D is the look- 
ahead depth. There will be a total of 2 D+l paths and 2 I>+2 -l nodes in the binary tree. With 

10 every input spectral shaper frame 3Q +r> , a new root node is selected and the trellis is extended 
at level D. Each node at level D has two state transitions emanating from it resulting in a 
total of p=2 D+1 nodes at level D-rl. The metrics corresponding to each of the p state 
transitions are computed. These are the branch metrics. The path metrics for the p paths are 
updated by adding the branch metrics to the accumulated path metrics of nodes at level D. 

15 The node at level D-H which gives the lowest path metric according to a criterion is selected 
as the best node. The tree is then traversed backwards from selected node to reach the root 
node. The state transition assignment for the spectral shaper frame Xj is selected to be either 
the left or right subtree of the root node according to whether the selected node is a left of 
the left or right subtree of this root. The tree is then updated with the root R^j being the 

20 node connected to R^. The leaves of the new tree so formed are at level D+ 1 . This procedure 
is continued for every new input spectral shaper frame. The memory requirements for this 
implementation is 0(2 D * 2 - 1). 

The procedure can be generalised for any trellis code with N states and M state transitions 
25 from each state. The tree thus formed will be M-ary and complete. The memory 
requirements for a lookahead depth D spectral shaper code in this case will be Of— — ). 

Figure 3 is a block diagram of processing apparatus for implementing the spectral shaping 
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scherne of the preferred embodiment of the present invention. The processing apparatus 9 
receives spectral frames X; as input, and outputs spectrally shaped output frames. The input 
spectral frames are provided to a delay buffer 1, which delays the input spectral frames by 
the look-ahead depth D before passing them to a state transition application circuit 2 which 
5 applies the spectral shaping and outputs the spectrally shaped output frames. The spectral 
shaping which is applied by the state transition circuit 2 is determined by spectral shaping 
processing circuitry on the basis of the input spectra! frames over the look-ahead depth. The 
spectral shaping processing circuitry includes a metric computation and trellis extension 
engine 3, a node memory RAM 3, a current root node state storage 6, a state transition 
10 information ROM 7, and a state transition selector 5. The operation of the processing 
apparatus 9 is described in greater detail hereinbelow. 

The input spectral frame buffer 1 is zeroed at reset. The decision on the state assignment for 
the first spectral frame is taken only after D spectral frames are input to the delay buffer 1. 

15 However all the operations in the preferred embodiment of the present invention are 
performed as in steady state. The metric computation and trellis extension engine 4 performs 
operation as in steady state during the start-up phase (e.g. during the first D spectral frames). 
This is achieved by assuming that a specific valid trellis path is taken irrespective of the 
metric computations. This is necessary because the first state in the trellis is predetermined. 

20 This predetermined path is used for updating of the next root node state 6 and subsequent 
updating of the nodes table in node RAM 3. This procedure is carried on till D-l frames are 
input to the trellis shaper. The procedure employed during the start-up phase is similar in 
every respect to that of the steady-state phase except that the root node state 6 is 
predetermined in the stan-up phase. 

25 

The input spectral frame is stored in the input spectral frame buffer 1. The same frame 
is input to the metric computation and trellis extension engine 4. The nodes at level D are 
extended with all possible state transitions emanating from them. The state transition 
information is read from the state transition information ROM 7. The metrics for all nodes 
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are computed and accumulated to get the path metrics for all possible paths starting from the 
root node. The path metrics so computed for all the paths emanating from nodes at ievel D 
are compared and the one which satisfies the path selection criterion is chosen as the best node 
at level D + l. The subtree which contains the best node is then chosen and the node RAM 
5 3 is updated with the nodes at level D in the subtree. The current root node state 6 of the 
trellis is also updated. 

The current root node state 6 and the best node at level D + l computed by the metric 
computation and trellis extension engine 4 is used to select the state transition between the 
10 current root node and the next current root node. The state transition selector 5 receives the 
state transition information from ROM 7. The state transition information is then applied to 
the D* previous input spectral frame by the state transition application circuit 2. The resultant 
frame is the spectrally shaped frame. 

15 As mentioned above, the metric computation and trellis extension engine 4 computes the 
branch metric for all possible state transitions emanating from nodes at level D. The path 
metrics starting from the root nodes to all the nodes at level D+l are accumulated. There 
is sufficient scratch memory in the metric computation and trellis extension engine 4 and node 
RAM 3 to hold the temporary node memory for level D+l. After searching for the best path 

20 which satisfies the preferred criterion, the sub-tree which contains the best node at level D + 1 
is stored in node memory 4. The node memory 4 is a linear array of all nodes at level D. 
For a two state trellis code with two state transitions from each node, Figure 2 illustrates the 
steady state tree structure with level D + 1 for a look-ahead depth of D =2. The allocation for 
the nodes in node memory 4 is Nl, N2, N3, ..... N8 and in that order. This structure is very 

25 efficient because when the best node is computed, it is very easy to locate the subtree (left or 
right for the binary tree case) to which the best node is connected to. This provides the state 
transition and the root node for the next iteration. 

An example of a trellis based spectral shaping code is illustrated in Figure 1 for the case of 
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M— 2, and N=2, and Figure 2 is the corresponding steady state representation of the binary 
tree with look-ahead depth of D=2. During the start-up phase, the trellis state is 
predetermined to be state S 0> for example. The first D-l spectral shaper frames X lt X 2 , 
X^i, are stored in the input frame buffer L Each frame is fed to the metric computation and 
5 trellis extension engine 4, where the branch and path metrics for all the paths are computed 
as if in the steady state phase. The node memory 3 is updated such that a fixed trellis path 
starring from state S 0 is followed irrespective of the path metrics and the selection criterion. 
This is done because complete node information for the whole path is not available until the 
spectral shaper frame X D is provided to the metric computation and trellis extension engine 
10 4. The current root node stare is also predetermined, according to the selected valid trellis 
path starting from the predetermined initial state S 0 . 

When the spectral shaper frame X D is provided to the input buffer 1 and the metric 
computation and trellis extension engine 4, the steady state phase is reached. The trellis is 

15 then extended to level D-f 1. The branch metrics for sill states emanating from nodes at level 
D are computed and accumulated with the previous path metrics to obtain the total path 
metrics. For the M=2, N=2 case, for any lookahead depth 1, the state transitions at 
level D-f 1 will be the state transition a, b, c, d,.. ..a, b, c, d, and it is not necessary to store 
this information in state transition information ROM 7. A total of 2 D+l path metrics are 

20 computed for every new input at level D-f 1. The paths are numbered 1, 2, 3, 4 ....2 D+1 and 
are stored linearly in memory, the path which satisfies the spectral shaping criterion will be 
selected as the best path, and the selected path number decides whether the best path is in the 
left or right sub-tree. If best path number is less than or equal to 2 D , then the left subtree is 
selected, else the right subtree is selected. Knowing the current state and the best node, the 

25 current root node state 6 is updated. The metric computation and trellis extension engine 4 
updates the node memory 3 with the selected subtree. The state transition for the spectral 
frame is loaded from state transition ROM 7 using the current root node state. It is then 
applied to the Dth previous frame to produce the spectrally shaped frame by the state 
transition application circuit 2. The above described procedure is followed for every 
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successive spectral shaper frame. 

The preferred embodiment of the present invention simplifies the design of the trellis based 
spectral shaper for variable look-ahead depth and variable spectral frame size. Treating the 
5 start-up phase and the steady phase uniformly reduces complexity. It also allows simple 
linear structures for storage of node information. This results in the effect of reducing design 
complexity of the trellis based spectral shaper by reducing computational and memory 
requirements. 

10 As will be appreciated by those skilled in the an from the foregoing description, operating 
directly in the steady state allows usage of a structure which is not a M-ary tree. The RAM 
requirements for storing the node information in node memory 3 is OiM^) . The M-ary tree 
traversing is also circumvented by using the state of the root node for determining the state 
transition association with the current spectral shaper frame X v This enables a significant 

15 reduction in memory and computational requirements. 

The foregoing detailed description of embodiments of the present invention has been 
presented by way of example only, and is not intended to be considered limiting to the 
invention as defined in the appended claims. 
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Claims: 

1 . A method of coding digital data for Transmission according to a trellis coding 
system having a predetermined number of (N) states and a predetermined number of (M) state 
5 transitions from each state, wherein the data is arranged in a series of frames, a state is 
associated with each frame to determine a coding strategy for the frame, and a look- ahead depth 
(D) representing a number of data frames is selected, characterised by the step of: 

assigning an initial state for a first frame of the series of data frames, and assigning 
states for the subsequent data frames in the series of data frames up to the look-ahead depth 
10 according to a predetermined valid trellis path, the method further including: 

sequentially fetching subsequent data frames in the series and determining respective 
states therefor based on a path metric for state transitions computed over the number of frames 
represented by the look-ahead depth; and 

coding the data frames for transmission according to the coding strategies corresponding 
15 to the states assigned or determined for the frames, wherein the series of data frames are coded 
for a shaped spectrum upon transmission thereof. 

2. A method as claimed in claim 1, wherein fetched data frames are buffered over said 
look-ahead depth from a current frame X[ to a look-ahead depth frame Xh-d- 

20 

3. A method as claimed in claim 2, wherein node infomiation for nodes representing 
possible state transitions at the look-ahead depth are stored in a node memory in an ordered 
array, and wherein the coding strategy for the current data frame X; is determined on the basis 
of a node selected at the look-ahead depth according to said path metric. 

25 

4. A method as claimed in claim 3, wherein the node information in said node memory is 
replaced for each new data frame in the series. 

5 . A method as claimed in claim 3, wherein the coding strategy for the current data frame 
30 Xj is determined according to a state transition from the state associated with said current frame 

which is determined by a comparison of the position of the node selected at the look-ahead 
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depth with at least one predetermined threshold. 



6. A data encoder for generating spectrally shaped coded data according to a trellis coding 
system, wherein the data is arranged in a series of data frames from a data source and a trellis 
5 state is associated with each data frame such that a coding scheme for each frame may be 
determined on the basis of transitions of states for frames over a selected look-anead depLn (D), 
comprising: 

a buffer memory coupled to the data source for buffering data frames in the series of 
data frames by the selected look-ahead depth (D); 
10 a metric computation and trellis extension engine coupled to sequentially receive said 

data frames from the data source and determine node information in a plurality of nodes for each 
said frame representing possible states, state transitions from a preceding frame and path metrics 
for the state transitions; 

a current state storage coupled to the metric computation and trellis extension engine for 
1 5 storing the state of a current frame in the series of data frames; 

a node memory coupled to the metric computation and trellis extension engine for 
storing said node information for nodes of a frame succeeding the current frame by the look- 
ahead depth; 

a coding scheme memory for storing a correlation between state transitions and 
20 respective coding schemes; and 

a processing circuit coupled to the coding scheme memory and metric computation and 
trellis extension engine for applying a selected coding scheme to a data frame to generate 
spectrally shaped coded data; 

wherein said metric computation and trellis extension engine determines the selected 
25 coding scheme for the current frame according to the state stored in the current state storage and 
a node for the frame succeeding the current frame by the look-ahead depth which is selected on 
the basis of the path metric for the node, characterised by: 

the metric computation and trellis extension engine assigning an initial state for a first 
frame of the series of data frames, and assigning states for the subsequent data frames in the 
30 series of data frames up to the look-ahead depth according to a predetermined valid trellis path. 
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7. An encoder as claimed in claim 6 wherein, for the first frames within the look-ahead 
depth of the series of data frames, states and state transitions are assigned according to a 
predetermined valid trellis path. 

5 8. An encoder as claimed in claim 6 or 7, wherein for each said data frame received by the 
metric computation and trellis extension engine the node information in the node memory is 
replaced with new node information representing the received data frame and the possible state 
transitions from the preceding data frame, 

10 9. An encoder as claimed in claim 8, wherein the node information for the nodes is stored 
in linear array in said node memory, and wherein the coding scheme for the current frame is 
determined according to the position of the selected node within the node memory linear array. 
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